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MELAyED APPlpALS AND INTORggRgNC^^^ 
There are no other ^eals or interferences known to the Appellants or the Appellants' 
representative, which are believed to directly afifect or be ditecily affected by or have a bearing 
on the Board's decision in the pending appeal. 
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STATUS OF CLAIMS 
Claims 31-38 are pemJmg. Tbe final r^ection of claims 31-38 foim the basis for this 
appeal Claims 31-36 Imve hem rejected under 35 U,S.C- §l02(e) as being amicipated by 
Rangan et al-, US, patent m>- 6,198,833, Claims 37 and 38 have been rejected un 35 U.S.C. 
§103(a) as being w^atentable over Rangan et al.» U.S. patent no. 6,198,833 in view of I^adore- 
Baneca et al.. U.S. Patent No. 6;205,231. 

STATUS OF AMEND^EfiryS 

AU amendments have been entered. Tbe claims as cnrremly amended are attached as an 
^ipendix. 

SUMMARY oy THE |yv]E|yF?Q^ 

The present invention relates to an automatic authoring syst^ for interactive television. 
In such interactive television systexns, it is desirable to 'tag" items of interest that n^y appear In 
the video frames which may be of interest to a viewing audience. Such interactive television 
systems allow the user to click on the tagged item during the broadcast {or additional information 
on the item of interest* In order to provide such capability, items of interest have to be tagged in 
all video tames where the items of interest may ^)pear. In a NTSC broadcast, video frames are 
broadcasted at a rate of about 30 frames per second- Thus, a one-hour broadcast would involve 
108,000 video frames. Tagging the 108>000 video frames for the various items of interest is an 
arduous task, to say the least. In order to solve this problem, automatic authoring systems have 
been developed. These systems allow a user to tag items of interest in a single video frame and 
the system automatically locates and tags these items in succeeding video frames. 

The present invention relates to a relatively simple method and ^paratus for tagging 
items of interest in video frames by associating a color IZQ of an object with an event. In 
particular, the system detennines the locations within each video frame where a selected item 
may ^pear. The system deterrrnnes the color value of the selected item by its digital color 
mathematic properties. For example, one embodiment of the invention utiliees the HGB 
standard which s^^arates the red 220, green 230, and blue 240 properties as the color as 
numerical values 250, Another embodiment uses the USV characteristics of the color which 
define the hue 320, sawration 330 and value 340 and compon«its of color. 
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Once m item of inierest is dmmiRed in an iniual the system tben automaticaUy 
locates the selected item based on the color matbematicdl cb^racterisiics in the remaining ftan^ 
in the broadcast, Thesi? items ^i^ then tagged and linlced to an event, such as a URL- One 
^nbodiment of the invention uses an edge detection scheme to define the boundaries fw the 
coloi« of the selected object. An important aspect of die pres«» invention is that the invention 
utilizes a relatively simple process for otherwise conqileting a rather arduous task. 

ISSUES ON AyyEfL 

I Should the Board reverse the rqection of claims 31-36 as being anticipated by 
Rangan et al.. U.S. patent no, 6,198,833 (hereinafter referred to as "Rangan,") 

II. Should the »oard inverse fte rejection of claims 37 and 38 as being unpat«table 
over Rangan ei al„ U,S. patent no. 6.198.833 in view of Jssadorc^Panreca et al-, US, Pstwt No. 
6,205,23l(hereinafter refiwred to as '*Issadore-BaiT©pa-**) 

CaOUPING OF CLAIMS 
It is respectfully submitted that the claims 31 -36 stand or ail together. Also, claims 37 
and 38 stand or lall together. 

ARGUMENTS 

t- ftfi^CTtOy OF CLAIMS 31-36 UND]E^ 3g y.S-C §1Q2(^) AS BEING 
UNPATENTABLE O V^jt RANGAN ET AL, 

Claims 31 and 32 have been rqectcd under 35 U,S,C, § I02(e> as being anticipated by 

Rangan, et al-, U.S. Patent No. 6,198,833. In order for ttiere to be anticipation, each and every 
one of the elements of the claims must be found in a single reference. It is respectfully submined 
that Claims 31 and 32, as well ^ Claiims 33-38, include elmients clearly not suggested or 
disclosed in die Rangaiu et al- patent. For example. Claim 31 recites, in combination, a method 
which includes a step for detemnning the location where an action by a pointing device has 
occurred. This claim also recites the step of determining a color value with the selected location 

and automatically associating an event widt the color value in succeeding video fiames. Claim 
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32 is similar- Claim 35 recites 9 system in vlwsb the locations afm object selected by a pointing 
device are detennined. This claim also recites d^ennimng a color range for the selected object 
and associating an event witb the color range in succeeding video frames. Claim 34 is similar. 
Claims 3S and 36 are similar but relate to a color pattern. Finally. Claims 37 and 3S are sinoilar 
but relate to an edge of a selected object Tbe Rangan patent does not disclose such elements- 

Rangan, on tbe otb^ band, traclcs a rectangnlar wire frame, having a &ced size around tbe 
location where the pointing device was exercised by comparing the color of individual pixels in 
d^e 6xed wire frame from one frame to ibe next- Rangan does not de^ an object based on its 
color, nor does it dynamically track the object based on colw as in the claims at issue. Rangan 
nracks objects based on the movement of individual pixels from frame to frame within a wire 
frame. This n^vemwt tracking is based on tbe initial wire frame location which is tracked in 
each frame and does not automatically associate a color with an object as in tbe claims at issue- 
Ttacking moveraem of the wire frame in Rangan demands testing of individual coordinates 
against their coumeipan from the previotis frame. This testing requires significant data to be 
computed at each frame. Further, it is respectfully submitted that Rangan's color signature am 
not pepresentative of a continuous color pattern- In particular, Rangan's color signature records 
the color value of every pixel in a fixed area rather than detecting a color pattern based on a 
region of interest- As such, it should be clear diat claims 31-36 disclose elements clearly not 
disclosed or suggested by Rangan* Thus, the Board is respectfrilly requested to reverse this 
rejection. 
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n. B^CriQN Oy claims 37-3g UNDER 3S U S,C, 8l03f AS BEING 
I JNP AT]pNTABLE OVER RaN GAN ET AL IN VIEW OF 
ISS aDORE-BARRECA ET AL, 

Claims 37 ana 38 rtcixt, in combinaucm, a metbod wd system for automatically 
i4emif>wg a bounded object based on color chaiacteristics in a series of video Barnes a«4 
associating an event v/itb said object ft is rc^ectfoUy submitted ftat claims 37 and 38 are not 
suggested by Rangan or Issadore-Banreca. As discussed above, Hangan does not track objects in 
the same mann^ as tbe system in tbe cuirem claims. ]h particular, Rangan tracks the movement 
of an object of fixed sbap^ by cconparing the color of individual pixels in a fixed mauix from one 
frame to the next. Nowhere does Rangan disclose or suggest tracking an object based solely on 
ite color, nor does it dynamically change the shape and size of rtie object based on color. 

The issadOT^'Baireca, et al. patem was ciied tar disclodng an edge detection scheme 
However, the Examiner has failed to show that an edge detection scheme would be compatible 
with the fired wire frame tracking method taught by Rangan- hadeed, both systems would appear 
to be incompatible with each other. 

Also, it is respectfully submitted that the Examiner has foiled to establish 9^ prima facie 
case of obviousness as set forth in MPBP § 2142 and § 2143. In order to establish ^prima facie 
case of pbviousness, three cnteriamust be met as set fCHlh in MPEP § 2143. 

**Fiist» there must be some suggestion or motivation, either in the references 
ih«nselves or in the knowledge generally available to one of ordinary skill in the 
ait, to modify the refer^ice or to combine referee teachings. Second, there 
must be a reasonable expectation of success. Finally, the prior art refference (or 
references when combined) must teach or suggest all the claim limitations. 

The teaching or suggestion to make the claimed combination reasonable 
expectation of success must both be fcund in die priw art, noi in the Applicant's 
disclosure.^ 

It is respectfully submitted that the examiner is combining two references in support of the 
rejections without a showing that the motivation for the combination was suggested by the 
reference itself. Moreover, none of die references, eldw singly or in combination, teach all of 
the elements of the claims. For example, all of the claims recite automatically associating an 
object with its color in a plurality of video firaraes. None of the refereuces cited disclose such an 
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amomanc authoring system* Moreover, there it; no leasonable expectaaon tbai the comhmed 
references would succeed io an interacQve TV application. For aU of the above reasons^ tb^ 
Board is respectfully requested to reverse the Examiner's rejection of claims 37 and 38, 
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CONCLUSION 



The Boaid is lespectfUUy requested xo reverse *e rqecticm of tbe claims by &e 
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CLAIMS ON APPEAL 

31. A metbod for mvojxmQviHy idea^fying an objeci in a plwaliiy of video &ames 
mi ^^ociatmg tbe object yfith a^ event comprising: 

determming a location in one of said video fiames where an action by a pointing device 
has occmred deSning a selected location; 

determining ^ color value of said selected location; and 

automatically associating an event with said color value of said selected location in said 
one video &anie and automatically associating events witb said color value in succeeding video 
&an^« 

32. A system for automatically identi^rog an object in a series of video frames and 
associating an event witb said object, tbe system comprising: 

a system for determining a location in one video frame where an action by a pointing 
device has occurred defining a selected location; 

a system for detennining a color value associated with said selected location in said one 
video frame; and 

a system for automatically associating an event with said color value in succeeding video 

frames. 

33. A method for automatically identifying an otyect in a plurality of video frames 
and associating tbe object with an event comprising: 

determining tbe coordinates of an object in a video frame apointing 
deviee defining a selected object; 

determining a color range for said selected object; and 
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automancdUy associating an event with said color range of said selected location in said 
one video firaine and autoinaticaUy associating events with said color value in succeeding video 

34. A system for mnomatically iaentilyiiig m <*jeci in a series of viOeo ftwies aii4 
associating m ev«it with said objed, the system comprisiBg; 

a system for (}etenmiwg the coordioates of an object w om video frame that has bew 
selected by a pointing device defining a selected object; 

a system for determining a color range for said selected object in said one video fiwie; 

and 

a system for antomaticaUy associating an event witb said color range in said one video 
frame and succeeding video frames. 

35. A method for automatically identifying an object in a plurality of video frames 
and associating the object with an event comprising: 

deteranning die coordinates of an object selected in one of said video frames by a 
pointing device defining a selected object; 

detennining a color partem for said selected object; and 

automatically associating an event with said color pattern of said selected location in said 
one video frame and automatically associating events with said color pattern in succeeding video 
frames. 

36. A system for automatically identifying an object in a scries of video frames and 
associating an event with said object, the system comprising: 

a system for deterouning the coordinates of an object in one video frame selected a 
pointing device defining a selected object; 
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a system for 4etcnwming a i^ojor pattern for said selected object in said one video frame; 

a system for aufomadcoUy associating an event with said color pattern in said one video 
frame and succeeding video frames. 

37- A method for antomaticaUy identi^g an olsject in a plwality of video frames 
and associating the object with an ev«Jt compnsing: 

det^mining the coordinates along one edge of an object in one of said video frames 
selected by a pointing device defining a selected ol^ect; 

determining the color values alcsng said edge of said selected ot^ect; and 

automaticaUy associating an event wiib said color values along said edge in said one 
video frame and automatically associating events with said eolor values in succeeding video 
frames associated with the color values. 

38. A system for automatically identifying an object in a series of video frames and 
associating an event with said object, the system comprising: 

a sysiem for detennining the coordinates along one edge of an object in one video frame 
selected by a pointing device defining a selected object; 

a system for detetmining the color values along said edge of said selected object in said 
one video frame; and 

a system for automatically associating an evem with said color values in said one video 
frame and succeediz^ video frames. 
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